Web Survey Bibliography
Previous research shows that changes in number-label association can affect respondents’ answers. In our first study, conducted with members of KnowledgePanel®, we manipulated the order of presentation of a fully labeled five point satisfaction scale (very satisfied to very unsatisfied); the association of numbers from 1 to 5 to each scale point; and we also reversed the number order (from 5 to 1). This manipulation created six experimental conditions. For each condition, we presented seven different items on separate screens. The completion rate for this study, done in April 2008, was 71%.
In the second study we used only a polar point satisfaction scale and manipulated the order of the scale as well the number-label associations (1 to 5 or 5 to 1). This created 4 experimental conditions to which KnowledgePanel members were randomly assigned during a survey conducted in August of 2008 with a completion rate of 72%. For each condition, we presented seven different items on separate screens.
In the first study we investigated the differences between each version, focusing specifically on the following comparisons: response options with numbers associated vs. options without numbers; order of the response option presentation; and order of the number association. Results from experiment 1 suggest that (1) reversing the order of presentation makes a significant difference resulting in primacy effects and in an increase of time latency when the scale is shown starting from “Very unsatisfied”. (2) Changing the number-label association does not make much of a difference; it appears that for a fully labeled scale the label is almost overriding the number. (3) Respondents are, however, slightly confused when the number-label association does not go in the expected direction.
In the second study we compared the 4 experimental groups, first between (same order of presentation but reversing the number-label association), and then within (same number-label association but reversing the order of presentation of the scale). We did not find many significant differences among groups, thus leading us to conclude that for a polar point scale the number-label association has less of an impact than for a fully labeled scale.
Homepage (abstract)/(full text)
Web survey bibliography (100)
- Telephone versus Online Survey Modes for Election Studies: Comparing Canadian Public Opinion and Vote...; 2017; Breton, C.; Cutler, F.; Lachance, S.; Mierke-Zatwarnicki, A.
- The 2016 Canadian Census: An Innovative Wave Collection Methodology to Maximize Self-Response and Internet...; 2017; Mathieu, P.
- Gathering Opinions on Depression Information Needs and Preferences: Samples and Opinions in Clinic Versus...; 2017; Bernstein, M. T.; Walker, J. R.; Sexton, K. A.; Katz, A.; Beatie, B. E.
- A test of sample matching using a pseudo-web sample; 2017; Chatrchi, G., Gambino, J.
- Integration of a phone-based household travel survey and a web-based student travel survey; 2016; Verreault, H.; Morency, C.
- A streamlined approach to online linguistic surveys; 2016; Erlewine, M. Y.; Kotek, H.
- Population Survey Features and Response Rates: A Randomized Experiment; 2016; Guo, Y.; Kopec, J.; Cibere, J.; Li, L. C.; Goldsmith, C. H.
- Mode Effects in Electoral Polls: A Comparative Perspective ; 2016; Durand, C.
- Pitfalls, Potentials, and Ethics of Online Survey Research: LGBTQ and Other Marginalized and Hard-to...; 2016; McInroy, L. B.
- Mail merge can be used to create personalized questionnaires in complex surveys. ; 2016; Taljaard, M.; Chaudhry, S. H.; Brehaut, J. C.; Weijer, C.; Grimshaw, J. M.
- Internet-administered Health-related Quality of Life Questionnaires Compared With Pen and Paper in an...; 2016; Nitikman, M.; Mulpuri, K.; Reilly, C. W.
- What do web survey panel respondents answer when asked “Do you have any other comment?”; 2015; Schonlau, M.
- Explorations in Non - Probability Sampling Using the Web; 2015; Brick, J. M.
- On Bias Adjustments for Web Surveys; 2015; Fan, L.; Lou, W.; Landsman, V.
- Web panel surveys – a challenge for official statistics; 2015; Svensson, J.
- Estimation with Non-probability Surveys and the Question of External Validity; 2015; Dever, J. A.; Valliant, R. L.
- Measurement Properties of Web Surveys; 2015; Tourangeau, R.
- Using Web Panels for Official Statistics; 2014; Bethlehem, J.
- Do Web surveys facilitate reporting less favourable opinions about law enforcement?; 2014; Boivin, R., Cordeau, G.
- Evaluating a Web-based health risk assessment with tailored feedback: What does an expert focus group...; 2014; Vosbergen, S., Mahieu, G. R. Laan, E. K., Kraaijenhagen, R. A., Jaspers, M. W. M., Peek, N.
- Considerations for Conducting Web-Based Survey Research With People Living With Human Immunodeficiency...; 2014; O'Brien, K. K., Solomon, P., Worthington, C., Ibánieez-Carrasco, F., Baxter, L., Nixon, S. A., Baltzer...
- African-American breast cancer survivors’ preferences for various types of physical activity interventions...; 2014; Paxton, R., Nayak, P., Taylor, W., Chang, S., Courneya, K., Schover, L., Hodges, K., Jones, L.
- Measuring Mobile Phone Use: Self-Report Versus Log Data; 2013; Boase, J., Ling, R.
- Does the first impression count? Examining the effect of the welcome screen design on the response rate...; 2013; Haer, R., Meidert, N.
- Recruitment of Sex Buyers: A Comparison of the Efficacy of Conventional and Computer Network-Based Approaches...; 2013; Kolar, K., Atchison, C.
- Effects of Gamification on Participation and Data Quality in a Real-World Market Research Domain ; 2013; Cechanowicz, J., Gutwin, C., Brownell, B., Goodfellow, L.
- The Impact of News Photos on Support for Military Action; 2013; Soroka, S.; Loewen, P.; Fournier, P.; Rubenson, D.
- Identifying the real differences of opinion in social media sentiment; 2013; Pettit, A.
- Co-creation with TickiT: Designing and evaluating a clinical eHealth platform for youth; 2013; Whitehouse, S. R.
- Foster strengths and circumvent weaknesses: Advantages and disadvantages of online versus face-to-face...; 2013; Qiu, M., McDougall, D.
- 4 ways mobile research challenges insights pros; 2013; Rajan, B.
- Thoughts on using the new online qualitative tools; 2013; Freund, N. M.
- Optimizing quality of response through adaptive survey designs; 2013; Schouten, B., Calinescu, M., Luiten, A.
- Customer loyalty to a commercial website: Descriptive meta-analysis of the empirical literature and...; 2013; Toufaily, E., Ricard, L., Perrien, J.
- Discovering interest groups for marketing in virtual communities: An integrated approach; 2013; Wang, K.-Y., Wu, H.-J., Ting, I.-H.
- Multimode, Global Scale Usage: Understanding respondent scale usage across borders and devices; 2013; Pettit, F. A., Courtright, M.
- Insights into Action Profiling shopping occasions for retailers through mobile and online research; 2013; Churkina, O., Morris, T.
- Recent Experiences with Electronic Questionnaire Testing at Statistics Canada ; 2013; Lawrence, D.
- A nationwide web-based freight data collection; 2013; Samimi, A., Mohammadian, A., Kawamura, K.
- Use of a Social Networking Web Site for Recruiting Canadian Youth for Medical Research; 2013; Chu, J. L., Snider, C. E.
- P02.04. Internet survey confirms strong interest in Yoga among fibromyalgia patients; 2012; Carson, J., Bennett, R., Jones, K., Mist, S.
- Approaches to empiric ablation of slow pathway: results from the Canadian EP web survey; 2012; Laish-Farkash, A., Shurrab, M., Tiong, I., Verma, A., Amit, G., Kiss, A., Morriello, F., Singh, S.,...
- Biting the Hand and Bending the Rules: An IJMR Presentation; 2012; Pettit, A.
- Mixed Mode: Phone and Web Discussion on Efficient Strategies; 2012; Gagnon, M.
- Survey Quality; 2012; Lyberg, L. E.
- Adaptive web sampling in ecology; 2012; Thompson, S. K.
- Respondent-driven sampling; 2012; Schonlau, M., Liebau, E.
- Firefly Online Surveys: A fully featured tool for Web surveys and forums; 2012; Deal, K.
- Where is Neutral? Using Negativity Biases to Interpret Thermometer Scores; 2012; Soroka, S., Albaugh, Q.
- Online and Paper-Based: A Mixed-Method Approach to Conducting a Needs Assessment Survey of Physicians...; 2012; Olatunbosun, T., Wu, C., Grewal, G., Lynn, B.